Web Survey Bibliography
Title The Impact of Response Scale Direction on Survey Responses in a Mixed-mode Survey
Author Hu, M.; Yan, T.; Keusch, F.
Year 2016
Access date 03.06.2016
Abstract
So far, no conclusive empirical evidence exists that would help guide questionnaire designers to make informed decisions on whether rating scales should ascend from the positive pole (or highest level) to the negative pole (or lowest level) or should descend from the negative pole (or lowest level) to the positive pole (or highest level). While previous research found mean shifts and changes in proportions endorsing various response options under different scale directions, but little is known about the influence of scale direction on other properties of the resulting answers (e.g., factor structures, internal consistency of resulted factors). Also, only limited attempts have been made in trying to reveal the underlying cognitive mechanisms at play when answering response scales. In an experiment in the UK Innovation Panel administered face-to-face and over the Web, respondents were randomly assigned to answer two sets of multi-item batteries (5 items on life satisfaction and 20 items from the Balanced Inventory of Desirable Responding) on a descending scale or an ascending scale. Preliminary analyses indicate that the scale direction significantly affects resultant survey responses by pushing answers to the beginning of the scale. We found that the mode of data collection does not interact with scale direction – scale direction effect is shown in both the CAPI and the Web mode. Further analysis will focus on the influence of scale direction on factors structure and internal consistency of the resulted factors and the role of satisficing in explaining response behavior to rating
questions.
questions.
Access/Direct link Conference Homepage (abstract)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Yan, T. (13)
- The Impact of Response Scale Direction on Survey Responses in a Mixed-mode Survey ; 2016; Hu, M.; Yan, T.; Keusch, F.
- The Impact of Scale Direction, Alignment and Length on Responses to Rating Scale Questions in a Web...; 2016; Keusch, F.; Liu, M.; Yan, T.
- Impact of response scale direction on survey responses in web and mobile web surveys; 2015; Yan, T.; Keusch, F.
- The Effects of the Direction of Rating Scales on Survey Responses in a Telephone Survey; 2015; Keusch, F., Yan, T.
- Analyzing Paradata to Investigate Measurement Error; 2013; Yan, T., Olson, K.
- Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of...; 2011; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Nonresponse Error, Measurement Error, And Mode Of Data Collection: Tradeoffs in a Multi-mode Survey...; 2011; Sakshaug, J. W., Yan, T., Tourangeau, R.
- Experiments Exploring the Relationship (or Lack Thereof) Between Nonresponse Error and Measurement Error...; 2008; Tourangeau, R., Groves, R. M., Presser, S., Toppe, C., Kennedy, K., Yan, T.,
- Fast times and easy questions: the effects of age, experience and question complexity on web survey...; 2008; Yan, T., Tourangeau, R.
- Sensitive questions in surveys; 2007; Tourangeau, R., Yan, T.
- How successful I am depends on what number I get: The effects of numerical scale labels and need for...; 2006; Yan, T.
- Gricean effects in self-administered survey. Ph.D. Dissertation; 2005; Yan, T.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.